[ELECTRONIC MUSIC]
Hello again, now the short video that you are about to see
it is an explanation about the NER model and the IRA model.
Carlo Eugeni will give us an explanation about both models
and their main differences. I hope you will enjoy it.
There are different models that are used to assess quality.
One is the NER model based on Word Error Rate system.
Basically...
it is aimed at comparing the source text
and the target text,
and see if the words of the target text
correspond to the ones in the source text
this model is very good for analysing
and assessing verbatim subtitles.
If subtitles are sensatim
the NER model also provide tools
for assessing if...
If the quality of the reformulation is good or not.
But it is not really developed.
That is why in Italy or at least in some cases
we use the IRA model
which is idea-unit rendition assessment.
It is based on idea-units.
The rational of the IRA model is...
Does the subtitle
provide the same message as the source text, the speech?
If yes, then the all subtitle is considered...
as good.
So it is not based on word it is based on idea units, on sentences,
or clauses.
So it follows a different rationale
because it sees if there has been a message
which has been delivered or not.
For example, in a long sentence with many adjectives
if you remove one
in the case of the NER model you have one mistake
in the case of the IRA model you do not have mistakes
because the message is delivered.
The other way around
if one word is missing in the IRA model
and this word is the verb for example,
meaning that you are not able to deliver the message
in the case of NER model it is one mistake
in the case of the IRA model
it is a all idea-unit which is compromised.
They both work very well
with what they are designed to assess,
meaning verbatim subtitles in the case of the NER model
and sensatim subtitles in the case of the IRA model.
But I see some limitations in both
because it depends on how you use them.
[ELECTRONIC MUSIC]